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[57] ABSTRACT 

A probabilistic resource allocation system is disclosed con- 
taining a low capacity computational module (Short Term 
Memory or STM) and a self-organizing associative network 
(Long Term Memory or LTM) where nodes represent 
elementary resources, terminal end nodes represent goals, 
and directed links represent the order of resource association 
in different allocation episodes. Goals and their priorities are 
indicated by the user, and allocation decisions are made in 
the STM, while candidate associations of resources are 
supplied by the LTM based on the association strength 
(reliability). Reliability values are automatically assigned to 
the network links based on the frequency and relative 
success of exercising those links in the previous allocation 
decisions. Accumulation of allocation history in the form of 
an associative network in the LTM reduces computational 
demands on subsequent allocations. For this purpose, the 
network automatically partitions itself into strongly associ- 
ated high reliability packets, allowing fast approximate 
computation and display of allocation solutions satisfying 
the overall reliability and other user-imposed constraints. 
System performance improves in time due to modification of 
network parameters and partitioning criteria based on the 
performance feedback. 

21 Claims, 2 Drawing Sheets 
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1 

PROBABILISTIC RESOURCE ALLOCATION 
SYSTEM WITH SELF-ADAPTIVE 
CAPABILITY 

This invention was made with Government support 5 
under contract NAS2 13700 awarded by NASA, The Gov- 
ernment has certain rights in this invention. 

FIELD OF THE INVENTION 10 

This invention relates generally to systems for solving 
resource allocation problems, wherein the ability of the 
system to provide optimal solutions to problems of a given 
class improves over time through simplification of the 
decision-making process. More particularly, the invention 
relates to methods and systems for solving a wide class of 
resource allocation problems, wherein common elements of 
prior solutions are employed to simplify computation of 
successive solutions. 

20 

BACKGROUND OF THE INVENTION 

For many years, workers have sought improvement in the 
automated solution of resource allocation problems. 25 
“Resource allocation problems”, as used in this application, 
encompasses many different classes of problems. For 
example, a classical resource allocation problem is the 
so-called “traveling salesman” problem, wherein the ques- 
tion is to find the most efficient route to be taken by a 30 
traveling salesman through a series of stops, for example, all 
48 state capitals of the continental United States. Additional 
constraints may include that no capital can be visited more 
than once, that the trip is to be accomplished using minimum 
total mileage, or the like. One way of solving this problem 35 
would be to compute all possible paths and simply to 
determine which had the least total mileage. However, as 
will be appreciated by those of skill in the art, there are so 
many possible paths that this problem is computationally 
very costly to solve using this “brute force” approach. 40 
Accordingly, the art has sought ways to simplify such 
problems. 

Another class of resource allocation problems relates to 
the targeting of specified resources, such as weapons, 
towards specified goals, such as targets to be destroyed. The 45 
problem takes on additional complexities when it is realized 
that the likelihood of success of each weapon with respect to 
a particular target must be taken into account. Further, while 
the most reliable weapon may initially be targeted to the 
most important target, thus requiring evaluation of the 50 
relative importance of the targets in addition to reliability of 
the weapons, consideration of further constraints may also 
be necessary. For example, it may transpire that one of the 
targets cannot be successfully attacked other than with a 
single most effective weapon, meaning that another target, 55 
possibly the most important, must be attacked with less 
effective weapons if the overall solution is to be of value. As 
individual targets are hit, the relative priorities of the targets 
may change, depending on actual success ratios. A suitable 
mechanism for solving such a problem must also take into 60 
account multiple targeting of various weapons on the same 
targets to ensure their destruction, and other similar con- 
straints. Defensive considerations must also be accounted 
for. Again, the “brute-force” approach of trying all possible 
solutions in order to select the most efficient is prohibitively 65 
costly in terms of the computation time and resources 
necessary. 
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The prior art has proposed solution of such complex 
problems using so-called “neural network” techniques. Neu- 
ral networks may be considered to be sets of nodes con- 
nected by links, and may be realizable either physically or 
in computer software. Decisions are made based on plural 
weighted inputs to each node. The advantage of neural 
networks is generally considered to be that they “learn” in 
the sense that in a series of trials they can improve their 
performance, gradually approaching the optimal solution of 
a given problem. Numerous references describe neural net- 
works both theoretically and their application to various 
practical problems, and additional references provide further 
improvements thereon. See generally U.S. Pat. Nos. 5,276, 
772 to Wang et al, 5,050,095 to Samad, 5,040,134 to Park, 
5,222,195 to Alkon et al, and 5,276,771 to Manukian et al. 

However, so far as known to the present inventor, no 
neural network solution is entirely satisfactory for solution 
of resource allocation problems as generally above, particu- 
larly in that the performance of neural networks degrades 
steeply when the constraints of a particular problem deviate 
from those initially learned by the network. Generally, 
performance gains obtained by a neural network’s learning 
a solution to one problem do not carry over to another 
problem, requiring the network to be completely retrained. 
As resource allocation problems of a given class vary widely 
due to changes in the set of available resources, modification 
of allocation priorities, and other constraints, neural net- 
works are not satisfactory for efficient solution of resource 
allocation problems. 

SUMMARY OF THE INVENTION 

The present invention addresses these deficiencies of the 
prior art by providing a self-adaptive system for solving 
resource allocation and similar problems. According to the 
invention, prior solutions to similar problems are stored and 
used in partial solution of later problems. Where a particular 
set of allocation decisions is made in a successful solution to 
a problem, and the same allocations are useful in solution of 
a subsequent problem, that fact is automatically stored. That 
subset of allocations can then be replaced by a single more 
simplified representation of the group of allocations in 
subsequent solutions of problems from the same class of 
problems, saving on the computation time required to per- 
form the entire solution. 

Taking a very simple example, suppose that in the trav- 
eling salesman problem described above, the salesman must 
visit all of the 48 capitals of the contiguous United States 
while traveling the least total number of miles. As indicated 
above, it is computationally inefficient to carry out all 
possible solutions to determine the minimal amount of 
mileage required. However, in carrying out a number of 
solutions it may be apparent that in each case the salesman 
visits Annapolis, Md., Wilmington, Del., and Trenton, N.J., 
in sequence simply because these capitals are so close to one 
another. If the United States is represented as a network, 
wherein the capitals are represented by the nodes and 
highways are represented by links connecting the nodes, 
according to the invention, three nodes, representing the 
three capitals, are replaced by a single “supemode” in 
calculation of the complete solution. Simply reducing the 
number of possible nodes which must be visited in sequence 
from 48 to 46 in this way substantially reduces the compu- 
tation time. Similarly, other groups of capitals may always 
be visited in sequence, further simplifying the calculations. 
For example, Concord, N.H., Boston, Mass., and Augusta, 
Me. would also typically form a single supemode, further 
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simplifying the computation. When the solution is deter- 
mined, the supemodes are replaced by their constituent 
nodes and links, thus “reconstructing” the network. 

In this example, the nodes represent actual points in 
space, and the links between them the actual distances 
therebetween. In other problems, the nodes may be physical 
objects, such as weapons having finite probabilities of 
success, and the links their allocation to targets; or the nodes 
may be intangibles, such as funds, and the links sequences 
connecting events in time; or the nodes may be personnel, 
and the links the time required to carry out needed work. In 
each case, a network provides a useful way to model the 
choices presented between the various options available. 

While the example given above of the traveling salesman 
problem may seem trivial, in fact the conventional wisdom 
in computer programming generally is to analyze all pos- 
sible solutions, that is, to rely on the “brute-force” power of 
the computer to carry out massive computations in order to 
determine optimum solutions to complex problems in 
resource allocation. Even with modem “parallel processing” 
computers, which divide the computational load between 
plural processors to solve massive problems, the computa- 
tion time required to solve such complex problems is 
excessive. 

According to an important aspect of the invention, repeti- 
tive computations common to given classes of problems are 
automatically recognized. A partial solution, typically 
derived in solution of one or more prior problems, is 
automatically and optimally substituted for the repetitive 
computations in arriving at an optimum solution to each 
subsequent resource allocation problem. This process may 
be referred to as “decomposition” of the network connecting 
the resources available to the goals to be satisfied. When the 
optimum solution has been determined, the complete net- 
work is reconstructed, providing a complete solution to the 
problem. 

Examples of the use of the invention in reconfiguration of 
a node system include power routing in the case of partial 
grid failure in a power distribution system, information 
rerouting in a communication network connected by com- 
munications processors at physically spaced nodes, or 
rerouting of goods and the like in a complex transportation 
system to compensate for temporary road blockages and the 
like. In these systems, the nodular structure of the network 
connecting the resources to be allocated to the goals to be 
satisfied is apparent. However, as indicated above, the 
system of the invention has applicability to resource allo- 
cation problems beyond such clearly nodular structures. 

Allocation of weapons to targets to be destroyed is a 
common resource allocation problem, often involving the 
assignment of literally thousands of weapons to hundreds of 
targets. An optimum solution, or even a near-optimum 
solution to a particular problem, cannot be found other than 
by extensive modeling. Nonetheless, as indicated above in 
the case of the traveling salesman problem, certain partial 
solutions do appear repetitively, e.g., in repeated simulations 
involving likely sets of resources available and targets to be 
hit. In subsequent calculations, those partial solutions 
known to be effective can be substituted for the correspond- 
ing portion of the complete network, greatly shortening the 
computation time required. 

In this example, the nodes are physical objects, such as 
weapons and targets. There are two types of links: links 
between weapons and targets, representing allocation of 
weapons to different targets weighted by finite probabilities 
of success, and links between the weapons themselves, 
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weighted by the relative frequency of joint allocation of 
those weapons to targets in a series of weapon allocation 
problems. In the latter case, the strength or “reliability” of 
“resource-to-resource” links connecting weapons represent 
5 the frequency of allocation of that combination of weapons 
to a target. Automatic recognition of such effective joint 
allocations, and using this recognition to simplify the actual 
allocation process, is at the heart of the present invention. 

Specifically, after a sufficient number of resource alloca- 
10 tion problems have been solved, common resource-to-re- 
source connections form a network having links of varying 
strength depending on how often those connections have 
been exercised, that is, how often each combination of 
weapons has been jointly used throughout the history of 
previous allocations. The network is then self-partitioned 
into cohesive clusters, or “packets”, each including those 
weapons that, according to the accumulated experience, can 
usefiilly be allocated jointly against their targets. The pack- 
ets are then replaced with “supemodes” in actual resource 
allocation. As a result, the original problem of making 
20 allocation decisions with respect to each weapon individu- 
ally is dynamically reduced to a much smaller problem of 
allocating a few groups of weapons. 

Variation in the problem conditions, for example, addition 
of new weapons, change of target priorities, and the like 
25 entails addition of new nodes to the network, and/or change 
of connection weights. The network is then automatically 
and optimally repartitioned and new packets of nodes are 
formed to accommodate the new circumstances. Preferably, 
the partitioning algorithm balances the significance of new 
30 circumstances (that is, the weights of the new connections) 
against the already existing network properties, so that the 
newly computed groups incorporate the old ones in an 
optimal fashion. In this way the system builds continuously 
on its previous experiences, accommodating changes of 
35 conditions without limit and without performance degrada- 
tion. 

Recognition of repeated sequences of user activities can 
also be used according to the invention to simplify process- 
40 ing. For example, the teachings of the invention can be used 
in designing man-machine interfaces, e.g., the complex 
control panels required for control of aircraft, nuclear plants, 
chemical plants, and the like. Information indicating the 
items of data the user repetitively accesses and control 
45 actions taken in response to various repetitive sequences of 
events can be collected in prototyping the control panel, and 
used to simplify the user interface accordingly, for example, 
to conveniently provide the user those pieces of information 
and control options he has commonly requested previously 
50 in similar control situations. 

In a further example, presently available computer pro- 
grams such as word processing programs or the like typi- 
cally provide an initial user screen including a menu prompt- 
ing the user to select a control option from a menu, e.g., 
55 “File”, “Print”, “Edit”, “View”, “Help”, and the like. This 
initial menu, and a number of sub-menus, are organized in 
a “tree”, such that when the user selects a control option 
from one menu, a corresponding sub-menu appears, giving 
the user a new selection of options. These menus, and the 
60 sequence in which the various choices appears are selected 
by the system designer in accordance with his understanding 
of how the typical user will want to operate the system, i.e., 
in accordance with the system designer’ s best guess of likely 
operational sequences, so as to maximize convenience to the 
65 user. 

In many circumstances, however, the user may have a 
different idea of how the computer program should be 
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organized; that is, the user’s idea of the appropriate items to 
appear on each menu may differ from the system designer’s, 
in which case the user will commonly spend much time 
looking for various control options. Of course, the user can 
consult the manual and find the option he is looking for; 5 
however, it will be apparent that most users do not care to 
do so, and certainly do not care to do so more than once. 
Accordingly, it would be desirable if the program itself 
would monitor the sequence in which the user accessed 
various control options, and would adapt itself, and specifi- 10 
cally its sequence of menus, so that the control options 
previously sought by the user would be subsequently pre- 
sented by menus so as to allow the same sequence used 
previously to be conveniently followed. Accordingly, this 
also is within the scope of the invention. 15 

In one embodiment of a system according to the inven- 
tion, it may be configured as a long-term memory having 
self-organizing associative capabilities, effectively connect- 
ing nodes by links, a short-term memory where on-line 
resource allocation decisions are made based on the resource 20 
associations established off-line in the long-term memory, 
and a supervisory and interaction management module pro- 
viding operator interaction and control functions. 

The short-term memory performs the actual allocations, 
based on the network output, and can provide near optimal 25 
allocation, e.g., by applying the solution of the most simi- 
larly prior problem to a new problem. The long-term 
memory carries out the detailed computations required to 
identify packets and carry out decomposition of the network. 
Over time, as the long-term memory becomes more and 30 
more efficient due to simplification of the decision tree by 
recalling previously successful partial solutions, the capa- 
bility of the short-term memory grows concomitantly 
greater. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be better understood if reference is 
made to the accompanying drawings, in which: 

FIG. 1 shows a two-dimensional matrix of the type 40 
commonly used in the prior art to evaluate the net gain of a 
particular set of resource allocations, as a step in an overall 
resource allocation computation; 

FIG. 2 shows a schematic outline view of a self-adaptive 45 
resource allocation system according to one embodiment of 
the invention; 

FIGS. 3(a)-3(/) shows stages in the self-adaptive recon- 
figuration of the long-term memory of the FIG. 2 system as 
problems of a particular class are successively solved; and 50 

FIG. 4 shows the general outline of a network partitioning 
algorithm used in one embodiment of the invention in block 
diagram form. 

DESCRIPTION OF THE PREFERRED 55 

EMBODIMENTS 

The assignment of a finite group of weapons having 
differing probabilities of success with respect to various 
types of targets — for example, one type of missile may have 60 
a 90% success rate on stationary targets, but only a 50% 
success rate on airborne targets, another may have a success 
rate diminishing more rapidly with distance from the target 
than other types, and so on — is treated herein as an exem- 
plary research allocation problem. Typically, in the prior art, 65 
the most efficient allocation of such resources to their goals 
has been performed using a “brute force” approach wherein 
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all possible combinations of weapons to targets are tested, 
and the most efficient is selected. This evaluation normally 
requires calculation of the “gain” anticipated by assignment 
of each particular resource to a corresponding goal, by 
multiplication of the probability of success of that resource 
with respect to that goal, the goal being weighted in some 
meaningful way. 

For example, in a military situation, one will normally 
have weapons of a variety of striking forces and efficiencies, 
and a group of targets of greater or lesser significance. 
Destruction of the enemy’s offensive weapons may be 
valued more highly than destroying his supply depots, for 
example. Moreover, the success rate of a typical weapon will 
vary substantially depending on the target to which it is 
assigned; thus, while the value of destroying an entire 
aircraft carrier may be very great, the difficulty of doing so 
with a substantial probability of success may necessitate 
using even one’s most effective weapons elsewhere. Accord- 
ingly, in order to calculate the most favorable assignment of 
weapons to targets, each of the various combinations thereof 
must be evaluated and the net gain of each of the possible 
solutions compared to all the other possible solutions. 

FIG. 1 shows in highly schematic form a matrix exem- 
plifying a small fraction of the calculations needed in a very 
simple situation. In FIG. 1, resources Rj, R 2 , . . . R n are 
ranked vertically upwardly along the vertical axis of the 
matrix, while goals G lf G 2 , . . . G n are similarly aligned 
along the lower edge of the diagram. In a first assignment 
scenario, each of the resources R 1? R 2 , . . . R n is assigned to 
the correspondingly numbered goal. The gain for each 
assignment is the probability p,- of each resource meeting the 
particular goal multiplied by the significance of the goal Gy. 
Thus, the results of these calculations for a first assignment 
of resources to goals is the sum of the gains in each row of 
the matrix; for the lowermost row, the sum is: 

Mi Gi + |i2 G 2 . . • Mn G n = Z m, Gj 

V 

In the next upward column, each of the resources is 
moved one space to the left, in effect, and multiplied by the 
same goal, so that here the sum is: 

M2 Gi + ji 3 G 2 . . - Ml Gn - S Mi+i Gj 

V 

This is repeated until each of the resources has been 
applied against each of the goals; when there are ten each of 
goals and resources, this requires a hundred individual gain 
computations and ten sums to be evaluated. 

It will be immediately apparent, however, that this is only 
one of a larger number of possibilities, that is, this calcula- 
tion assumes that the order of the resources as applied to the 
goals is invariant. Actually, of course, there may be better 
solutions available if the order of the resources is altered in 
addition to altering their sequence of application to the 
goals. A very large number of additional computations will 
be required in such a “brute force” calculation to take into 
account each of the possible assignments. 

One possible simplification of the calculation can be 
accomplished by selecting the single gain term having the 
highest maximum value from the 10x10 matrix of FIG. 1, 
thus arbitrarily determining that this particular assignment is 
part of the optimum solution being sought. (This would 
normally only be done if there are no nonzero values in that 
particular row, corresponding to goals that simply cannot be 
met without assignment of a unique resource thereto.) If 
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such a single term is selected, a subsequent 9x9 matrix can 
be constructed, comparable to that shown in FIG. 1, to 
determine the next maximal gain term. The process can then 
be repeated by selecting the maximum value from that 
matrix, recalculating an 8x8 matrix, now having two assign- 
ments fixed, and so on. This results in some savings in 
computational time with respect to the “brute force” solu- 
tion. However, the optimal solution is realized only if the 
assumption that the maximum terms selected are part of the 
optimal solution is correct. 

A more general method for computing a near-optimal 
allocation of resource requires that each element of the 
matrix in FIG. 1 is computed as the potential gain yielded by 
allocating that resource to the corresponding goal minus the 
sum of potential losses caused by unavailability of this 
resource for allocation to all other remaining goals. After the 
largest element in the matrix is selected, thus allocating one 
resource to one goal, the entire matrix is recomputed for the 
still unallocated set of resources, and the process repeated, 
until the resource set is exhausted. 

The problem of assigning weapons to targets as above is 
but one of a vast variety of resource allocation problems that 
have been historically analyzed as above, namely, by trying 
all possible solutions and only simplifying the overall matrix 
when candidates emerge through extensive computation. 
Such problems are widespread throughout government and 
industry and a more efficient method of solution would be of 
great value. For example, there are thousands of organiza- 
tions in the United States alone where, every day, managers 
decide the most efficient sequence for delivery trucks on 
routes that vary only slightly day to day due to various 
customer needs and the like. Similarly, the military com- 
monly must assign literally hundreds of weapons, aircraft, 
missiles and the like to dozens of targets, if only for training 
purposes. Likewise, the power industry must make decisions 
continually on how to control flow of power through the 
power grid, transportation companies must assign loads to 
trains or long-haul trucks and select the best routes, com- 
munications networks are continually reconfigured to deal 
with various loading patterns, and the like. 

Each of the above listed problems is generally repetitive, 
in the sense that although the specific resources available 
and goals to be satisfied will vary somewhat from day to day, 
the problem is similar in overall scheme and complexity 
from day to day. Therefore, rather than completely analyze 
each day’s problem from ground zero, so to speak, it would 
be more appropriate and more conservative of computa- 
tional time and effort to employ applicable portions of prior 
solutions that had yielded good results, reducing the addi- 
tional computation time to that required to solve the differ- 
ences between each new version of a consistent class of 
problems and prior similar problems of the same class. 

The present invention provides a system and method for 
applying the resources and goals defining a particular prob- 
lem to be solved to a computational device storing the results 
of similar problems previously solved successfully, auto- 
matically identifying common elements of the problem, and 
using the prior knowledge to simplify computation of the 
solution to the particular problem. In one embodiment, the 
current problem is stored in short-term memory, providing 
near-optimal resource allocation, associated with a long- 
term memory for calculating the solution of a particular 
problem employing the previous solutions where applicable, 
to reduce the computation time required. 

It is of interest that this partition of functions is not unlike 
that provided by the human brain. If, for example, one plans 
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a trip to a city not previously visited, nearly every aspect of 
the trip is new and must be planned for carefully; the entire 
trip must be considered at length in short-term memory, as 
long-term memory provides little use in solving the particu- 
5 lar problem. By comparison, if one is making a trip to a city 
already visited, one will be aware of the typical weather 
conditions, and will know, for example, how to get from the 
airport to one’s hotel; in this case, one’s long-term memory 
will provide most of the solutions to individual problems 
necessary for planning the trip, and short-term memory is 
needed only to focus on the new aspects of the trip, i.e., to 
recall where various meetings are scheduled, what materials 
will be needed, and the like. 

Applying this analogy to more traditional research allo- 
cation problems, a Federal Express manager in a particular 
15 locality may know, for example, that on any given day he 
will have between 500 and 2000 packages to deliver to 
between 40 and 100 office addresses and will have between 
6 and 12 drivers available to do so. If, on any given day, the 
package load and addressing requirements are similar to 
20 those of previous days, he can simply assign his drivers 
routes driven on previous days with similar loadings. On the 
other hand, if he has a particularly elaborate or sensitive 
shipment to a particular location, he may take all shipments 
to that location out of their normal routine and assign one 
25 driver to that particular location only. Again, where possible, 
he will rely on previous solutions known to be useful in 
solving particular problems, that is, on information stored in 
long-term memory, such that short-term memory is required 
to address only the departures of the new problem from the 
30 prior problem. 

Similarly, in the battlefield environment, one goal of 
war-gaming is to train commanding officers to recognize 
patterns of weapons availability and target allocation that 
35 correspond to successfully solved problems and to adapt 
those solutions to address satisfactorily any new factors, 
such as unexpected losses or gains, and the like; in this way, 
the entire resource allocation process is performed effi- 
ciently, effectively relying on the benefit of prior knowledge. 
40 FIG. 2 shows one possible arrangement of computer 
resources or the equivalent for similarly partitioning the 
information and computation necessary to efficiently solve a 
particular example of a class of resource allocation problems 
according to the invention. FIG. 2 depicts this system as 
45 specific hardware components supplied with appropriate 
operating software. It will be appreciated by those of skill in 
the art that this depiction is essentially schematic, and that 
a general purpose computer, for example, could be pro- 
grammed to carry out the functions, and specifically the 
50 partition of functions described in connection with FIG. 2, 
without the explicit requirement of separate hardware ele- 
ments. The description herein of this embodiment of the 
invention should be considered as exemplary only of the 
invention and not as a limitation thereon. 

55 Referring now more specifically to FIG. 2, the system 
comprises a long-term memory unit (LTM) 20 configured as 
a number of nodes 22 connected by links 24, forming a 
network representing the solution to the problem. Goals G 1? 
G 2 . . . G n represent the end nodes in the network, while 
60 resources R n , R 21 , . . . R nl , R n , R 12 . . . R nk represent the 
starting nodes and the intermediate nodes. Thus, this 
arrangement allows explicitly for the possibility that 
resources are assigned at a plurality of intermediate nodes to 
solution of a particular problem; that is, the solution of a 
65 particular problem involves the connection of each of the 
goals G l5 G 2 , . . . G n to starting and intermediate resources 
R u , R 21 , . . . R 12 , . . . R nk . The “solution” thus essentially 
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involves the selection of links making connections between 
the nodes such that all the resources required to reach each 
particular goal are assigned thereto. 

As indicated at 26, the long-term memory unit 22 operates 
under the control of optimal network partitioning algorithms 5 
which are described in detail below. Essentially, these algo- 
rithms identify packets of reliably-connected nodes. This 
identification can be performed by monitoring the frequency 
of use of the links. A candidate packet may be replaced by 
a “supemode” when the sum of the weights exceeds the sum 10 
of the weights of the links making up the packet’s “cutset”, 
that is, a group of links separating the packet from the 
remainder of the network. 

Equivalently, the packets may be identified responsive to 
the determination that the average weights of the individual 15 
links in the packet are greater than the average weights of 
links in the corresponding cutset. In both cases, the packets 
identify groups of strongly connected, that is, repeatedly 
co-allocated, resources. 

20 

Resource allocation algorithms employed in the short- 
term memory solve a matrix equation designed to maximize 
the net gain of the solution, in addition to other functions 
provided according to the invention. As generally discussed 
above, the net gain of each possible solution is the sum of 
the individual gains determined by multiplication of the 25 
probability of success of each of the resources by the value 
of the corresponding goals. In various cases, additional 
terms for reallocation of the priorities of goals as other goals 
are met can be included, varying transactional costs may be 
associated with each of the intermediate nodes, these rep- 30 
resenting, for example, attrition, cost of replacement sup- 
plies and the like, and other features can be incorporated in 
order to model realistically the total cost of the satisfaction 
of the goals G 1# G 2 , . . . G n by allocation of specific resources 
Rn> ■ • • R„* thereto. 

As indicated, according to the invention, an important 
capability of the long-term memory is “self-partitioning”, 
that is, over time, packets of nodes and links that are 
objectively determined to be efficient in solution of a par- 4Q 
ticular class of resource allocation problems are replaced by 
simpler versions thereof. More specifically, over time, as 
particular examples of problems from a class of problems 
are solved, groups of resources will be assigned repetitively 
to satisfaction of goals or groups of goals. Where this is 45 
recognized, the number of computations required to calcu- 
late the maximal-gain solution of any particular problem can 
be simplified by replacing those groups of nodes and links 
by a simplified model thereof. This “decomposition” of the 
network is explained in further detail below in connection 5Q 
with FIG. 3. 

FIG. 2 also depicts the short-term memory unit (STM) 30 
which, as its name implies, stores information regarding the 
goals and resources assigned to a particular problem, and 
solves this problem using additional guidance of the LTM in 55 
the form of a simplified network. If such simplification is 
significant due to highly repetitive allocation solutions in the 
past resulting in the reduction of the network to a compara- 
tively small number of nodes, the STM applies path-finding 
algorithms to allocate groups of resources to the current 60 
goals. If, due to solution diversity in the past, the LTM 
network still remains of a relatively large size, the STM 
applies the basic matrix computation method but uses LTM 
guidance to reduce the matrix in comparison with its original 
size. 65 

More generally, short-term memory unit 30 has as input 
nodes the specific goals to be met G ls G 2 , . . . G„, and is 
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operated under the control of optimal resource allocation 
algorithms indicated at 32 and path finding algorithms 34 for 
providing initial solution possibilities to the long-term 
memory, as indicated by the interconnecting links shown 
collectively at 36. For example, the short-term memory 30 
may be capable of evaluating the differences between a 
newly presentee! problem, as defined by an exact set of 
resources to be applied to an exact set of goals, and the set 
of problems previously solved, in order to assist the long- 
term memory 20 in selecting the closest-fitting successful 
prior solution as a starting point for the calculation of the 
resource allocation matrix for the new problem. 

A further significant component of the FIG. 2 embodi- 
ment of the invention is the supervisory and interaction 
management module (SIMM) 40. The function of this unit 
is to provide a user interface as indicated at 42, that is, to 
accept specifics of the resources and goals from the user, as 
well as any updated information as to their availability 
which might affect the likelihood of success of each par- 
ticular resource, updated specifications concerning the rela- 
tive importance of the goals, including the reordering 
thereof as goals are met, and other information specific to 
the particular problem being addressed. Further, where the 
solution of the resource allocation algorithm (discussed in 
detail below) may reveal that alternative solutions appear to 
be possible, the user may be prompted to make a selection 
therebetween based on factors not explicitly entered into the 
problem. To this end, the supervisory and interaction man- 
agement module 40 receives input from the LTM as indi- 
cated at 44 and the STM as indicated at 46, as well as 
providing inputs thereto at 48 and 50, respectively. 

FIGS. 3 (a)-(/) show stages in assignment of links 24 
between nodes 22 connecting resources to goals in solution 
of a particular problem, and also illustrate how subgroups of 
links and nodes may be simplified as information over time 
is stored respecting a particular class of problems. In FIGS. 
3(a)-3(/), directed connections, e.g., links 52, 54, corre- 
spond to allocation decisions. Solution of each allocation 
problem produces a series of paths, each path comprising 
resources allocated to the goal indicated as the terminal 
point at the end of each path. In solving a series of similar 
problems, these links gradually develop into a network. 
Since the paths partially overlap, individual links acquire 
different weights (strength). Network self-partitioning 
according to the invention identifies packets (shown by 
shaded ovals in FIG. 3(e)) where the strength of the links 
internal to the packets exceeds the strength of the external 
links, indicating that resources in the packets have com- 
monly been used together. In subsequent allocation opera- 
tions (FIG. 3(f)), the packets are represented by single 
supemodes, such that the resources within the packets need 
not be considered individually. The transition illustrated by 
the series of FIGS. 3(a)-3(f) illustrates problem simplifica- 
tion achieved as a result of this invention. 

More specifically, FIG. 3(a) shows the LTM essentially as 
in FIG. 2, no links having been assigned between the nodes 
representing the resources R n , R 22 , . . . R nl , and the goals 
Gj, . . . G„. In FIG. 3(b), links have been established 
connecting some of the resources to some of the goals by 
solution of one of the typical resource allocation equations, 
described below. In FIG. 3(c), this process has been contin- 
ued. Note in particular that in FIG. 3(b) goal G 3 is connected 
to one of the initial resources R n , R 12 , . . . R nl by a complete 
path, while in FIG. 3(c) G 3 is no longer fully connected; this 
reflects replacement of the partial allocation represented by 
FIG. 3(b) with an updated solution during continued pro- 
cessing. This process is completed as shown in FIG. 3(d), 
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where each of the goals G x , . . . G„ has been connected to 
one of the input resources R n , . . . R nl . FIG. 3(d) thus 
represents a complete solution to the problem. In FIG. 3(e) 
tentative allocations of nodes to highly reliable “packets” 56 
have been made, reflecting highly reliable connections that 
are anticipated to be used in further similar problems. The 
identification of nodes making up packets 56 is discussed in 
detail below. Finally, in FIG. 3(f ) , packets 56 have been 
replaced by simplified “supemodes” 58 connected by links 
to each of the nodes to which the packets 56 had been 
connected. According to this important aspect of the inven- 
tion, the “supemodes” 58 replace the packets 56, simplifying 
the overall structure of the resource allocation matrix illus- 
trated by long-term memory 20, as can be readily appreci- 
ated by comparison of FIG. 3(f) with FIG. 3(d). 

In subsequent solution of similar problems, the nodes 
represented by packets 56 in FIG. 3(e) are replaced by the 
supemodes 58 of FIG. 3(f), thus substantially simplifying 
the computation of the connection of all the resources R n , 
. . . R nl to the goals G x , . . . G„. When the solution is 
subsequently completed, the supemodes 58 are replaced 
with the corresponding packets 56 in actual assignment of 
resources and sequences of connection therebetween as 
represented by the links connecting the nodes. 

The process of replacing commonly used nodes making 
up packets 56 with supemodes 58 according to the invention 
is referred to as “decomposition” of the matrix, and the 
process of replacing the supemodes 58 with the correspond- 
ing packets 56 in presenting the complete solution to the 
problem is referred to as “reconstituting” the matrix. 

FIG. 4 (discussed in detail below) shows a flow chart 
depicting the general scheme of network partitioning, that is, 
deriving the identification of packets 56. Summarizing this 
process, in essence, candidate packet assignments are first 
made. The frequency of use of the links connecting the 
nodes of the candidate packet to one another is compared to 
that of the links connecting the nodes of the candidate packet 
to the remainder of the nodes of the matrix represented by 
the LTM 20. The result of this comparison is to identify 
resources (represented by nodes) that are commonly 
employed collectively in solution of a class of problems, as 
indicated by the weights of the links connecting the nodes. 
Thus, if a particular group of links connecting two or more 
nodes of a candidate packet are used more commonly than 
the links connecting the candidate packet to outside nodes, 
the links and nodes comprising the packet can be replaced by 
a supemode and a smaller number of connecting links. The 
degree to which the usage of the links making up the 
candidate packets exceeds the usage of the outside links is 
a measure of the degree of utility or “reliability” of the 
packet; where relatively weakly-identified candidate packets 
reoccur in solution of successive problems, these can later be 
replaced with supemodes. 

The long-term memory can be configured as an actual 
network of individual processors connected by communica- 
tion links, the assignment of the links being implemented by 
switches, or as a software program, where the nodes are 
implemented as calls to a software subroutine calculating the 
gain available in a particular point in the resource allocation 
process, or in other ways apparent to those of skill in the art. 
Essentially the LTM represents a structured approach to 
performing many gain calculations; as such, the nodes can 
be implemented as calls to a gain-calculating subroutine and 
the links as communication of results to other similar 
subroutine calls. Alternatively, each node may be an indi- 
vidually-programmed processor, communicating with others 
as indicated by the links. It will be appreciated that the 
invention is not to be limited to the description herein of one 
implementation. 
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Those of skill in the art will recognize further that the 
node-and-link structure of the long-term memory 20 as 
discussed in connection with FIGS. 2 and 3 is in reality a 
simplified graphical representation of the kind of computa- 
5 tional processing discussed above in connection with FIG. 1. 
As noted, FIG. 1 showed one set of possible allocation of 
resources to goals, and illustrated the calculation of the net 
gain of each of that set of possible allocations. Specifically, 
in an example of FIG. 1, ten possibilities of assigning ten 
10 resources to ten goals may be evaluated. The discussion of 
FIG. 1 emphasized that these were only ten of a much larger 
number of ways in which those ten resources could be 
assigned to those ten goals, and that all other possibilities 
would have to be evaluated separately to determine that 
which yielded the maximum gain. Connection of the indi- 
vidual nodes of the long-term memory 20 by links corre- 
sponds, in effect, to one possible solution, that is, one 
possible application of resources to goals; the optimal 
assignment of the resources to the goals as determined by the 
final network arrangement is equivalent to trying all possible 
20 allocations and selecting that yielding the maximum gain. 
The simplified nodal structure, e.g., as shown in FIG. 3(f), 
wherein the supemodes replaced packets of nodes known to 
be reliable in solution of a class of problems according to the 
invention, is approximated in the matrix representation of 
25 FIG. 1, by selection of one portion of a given solution, which 
then simplifies the computation required to perform the 
remaining allocations necessary to satisfy all goals. In either 
event, according to this aspect of the invention, the calcu- 
lation process is simplified with respect to each successive 
30 example of a class of problems, by drawing on partial 
solutions determined in successful prior solutions of other 
problems of the same class. 

The following detailed discussion of FIG. 4 is sufficient to 
enable one of skill in the art to program a conventional 
35 system to perform the functions described above. 

FIG. 4 identifies the main computational components in 
the network partitioning algorithm for identifying packets by 
comparing the summary weight of internal links in the 
packet exceeding the summary weight of links in the cutset 
40 (the links connecting the packet to the surrounding net- 
work). 

The network, as submitted to the algorithm, is “prepro- 
cessed,” at step 60, which includes determination of the 
degree of prior partitioning, i.e., network connectivity. If the 
45 network is found to be partially disconnected, all the con- 
nectivity components are located and all the subsequent 
computations are applied to those components. If the net- 
work is substantially disconnected, the user is informed to 
that effect via the SIMM, and further computations are 
typically postponed until a sufficient number of allocation 
50 examples have been accumulated to ensure a sufficient 
degree of network connectivity. 

Edge sorting, performed in step 62, arranges connections 
in the decreasing order of weights. 

Spanning tree extraction is performed next, at step 64, to 
55 obtain a subnetwork in the form of a tree containing all the 
network nodes. Since usually several spanning trees can be 
obtained, the heaviest one (having the largest sum of con- 
nection weights) is selected for further processing. 

An algorithm for tree decomposition is then applied at 66 
60 to obtain the required packets in the spanning tree. Operation 
of the algorithm is based on determination of tree compo- 
nents in the form of simpler structures, such as chains, and 
gradual growing of those chains followed by their detach- 
ment from the tree after the required packet criteria are 
65 satisfied on the product of such growth, that is, when the 
summary weight of the resulting structure exceeds the 
summary weight of its cutset. 
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In an alternative and equivalent computation, the packets 
may be identified when the average weight of the links 
within the packets exceeds the average weight of links 
connecting the packet to outer nodes. Again, the effect of this 
comparison is to identify the most reliable of the links. 5 

The edge return module, step 68, resubmits for compu- 
tation those connections that were initially separated from 
the network during construction of the spanning tree at step 
64. The returned connections are either incorporated into 
already generated packets, or cause their merger into larger 
packets. In the latter case, the edge sorting step 66 is 10 
reapplied to establish a new order on the entire set of 
connections, and a new spanning tree is generated at 64 to 
include connections responsible for the merger of packets at 
the previous interaction cycle. The process continues until 
the same packets are generated repeatedly in the several 15 
subsequent cycles, indicating their reliability. The result is 
near-optimal partitioning of the network into the required 
packets, as indicated at 70. 

The parallel module, provided at 72, deals with special 
rare classes of networks having spanning trees which are not 20 
decomposable. In such cases, highly reliable connections are 
found in the network and are grown in parallel until the usual 
packet criteria are met thereby. 

Reference was made in the above to use of the invention 
to improve the performance of software. Such “interactive 25 
software” design according to the invention allows the 
software to have the capability to organize data and com- 
mands as they are selected by the user, e.g., to reconfigure 
a particular control panel arrangement, or to reconfigure a 
“tree” relating a series of user menus. According to the 3Q 
invention, the user’s pattern of selecting the control options J 
provided by a complex software-implemented system is 
monitored to, in effect, custom design his software interface. 

In this use of the invention, each command becomes a 
resource, and the system interface is updated to simulate the 
pattern of usage of the commands in a manner equivalent to 35 
replacing commonly-used packets of nodes and links with 
supemodes. 

Typically, commands selected repetitively become a 
packet organized by the software and presented as a menu of 
control options. For example, in connection with a “print” 40 
command used with a word processor, one will typically 
select a page format, a document format, a type font and so 
forth, and control menus displayed in response to the “print” 
command typically include these control options. However, 
no menu suits all users equally well. Some users may also 45 
select a printer; others may want to electronically fax the 
document; still others may archive the document. According 
to the invention, in this example, the menu appearing on the 
screen in response to selection of the “print” control option 
is adapted over time to prompt the user to select those 50 
control options which he had previously selected in con- 
junction with the “print” command, so as to simplify and 
speed subsequent use of the program. In a particularly 
simple implementation, where the user selects a control 
option not forming part of the menu displayed, that option 
is added to that menu. Those of skill in the art in designing 55 
user interfaces for computer programs will recognize meth- 
ods in which this self-adaptive user interface can be pro- 
vided without detailed disclosure thereof in this application. 

A further use of the invention relates to adaptive control 
panel design. As in the case of the adaptive software 60 
program interface just discussed, control panels (e.g., of 
power plants, aircraft, chemical plants and the like) typically 
comprise user information displays and user input devices, 
the latter comprising keyboards, mice, touch-screens, and 
the like. The user selects various control options responsive 65 
to the information displayed; commonly his choice will be 
for further information or further control options. According 


to the invention, the user’s pattern of selection of control 
options, e.g., during evaluation of a prototype of a new 
design, is monitored and used to reconfigure the display, 
and/or the sequence of display of further control options, to 
better suit the user’s convenience. 

The claims following are intended to include these and 
further uses of the system and methods of the invention 
where not specifically excluded therefrom. 

The following provides a more rigorous mathematical 
statement of the process of solving each of the elements in 
a resource allocation matrix as shown schematically in FIG. 
1, according to the invention. In the exemplary embodiment 
discussed herein, these functions are carried out by the STM, 
but the invention is not to be thus limited. 

A general probabilistic resource allocation problem is 
defined as follows: given a set of S goals having different 
relative priorities G x , G 2 , . . . G s , and a set of N resources 
Rj, R 2 , . . . R„ having different probabilities {t^} of 
satisfying the goals ({fty} is the probability that resource R 7 - 
will satisfy goal G t ), obtain the resource allocation matrix 
{8^-} that maximizes the objective function F of the form 

s ( » ■ \ m 

F=m= 2 G, ( 1- n <* 8 j, 

1=1 \ « / 

under the constraints 

5 

I 8/* = 1,7= 1, . . . ,N:, 
i= 1 

5^ c 1; 01; 1 ^ (eji = 1 - nji) ^ 0 

Equation (1) maximizes the gain G f ; the constraints 
simply express mathematically the condition that a particu- 
lar resource (each represented by its probability of success 
t^y) can only be used once. 

This optimal allocation algorithm allocates resources to 
goals sequentially, starting with the goal of the highest 
priority. At each step t, a special allocation matrix 


II Aik 


(2) 


is computed providing the value of objective function incre- 
ments, that is, the net gain for each allocation of a resource 
to a goal is computed for all possible allocations of all the 
resources remaining after the previous (t-1) allocation steps. 
At each step t, the allocation with the highest such increment 
is chosen, until the resource pool is exhausted. 

The basic algorithm is as follows: 

Step 1. Compute the components of the current matrix 








JfceJV™ Z=l, 2...S. 


(3) 


where: 


N 

Gf = G/,sJ. 0) = n e jh i, 1=1,2... S 
7=1 


and N (0 =remainder of the resource set still unallocated in the 
previous (t-1) steps. 

In Equation (3), the term G/*' 15 is the gain for the 
particular goal being processed, i.e., the gain obtained by the 
allocation of one or more particular resources to a goal Q lm 
The g; term represents the potential losses with respect to the 
remainder of the set of goals, that is, represents goals that 
can not be achieved due to a prior allocation of a resource 
to a particular goal. The process is repeated until all goals 
have been met. Subsequent steps evaluate other solutions. 
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Step 2. Allocate the k, resource to the 1, goal 

4^=1 

to satisfy the condition 


A Aj i i =max A kl . 

This step selects the maximal gain for a particular pos- 
sible solution. 

Step 3. Increment the objective function 
Fi=F t _ i+A*^, Fo=0. 

Step 4. Recompute G (/) and as follows: 
if l/h 


Step 5. If t<N, go to 1 ; the process is complete when t=N, 25 
that is, when all resources have been assigned. 

Analysis shows that the computational complexity of this 
algorithm, that is, the number of elementary operations 
required for solution, is directly proportional to N 2 . Forma- 
tion of imploded packets according to the invention reduces 30 
the number of nodes to some K«N, thus reducing the 
problem complexity. 

More specifically, each step in the algorithm requires 
computation of the matrix 

)|A$| \ns 35 


for all the N (/) remaining components. As packets are formed 
according to the invention, such matrices are limited to the 
members of a subset of packets only, entailing savings at 40 
each step in the algorithm. In other word, formation of 
packets replaces the original problem of allocating N 
resources with the problem of allocating K “macro-re- 
source” (packets) (K«N), each macro-resource acting 
against only a subset of goals. 45 

In a more general resource allocation problem, interaction 
among the goals can be accounted for by presuming that 
satisfaction of some goal G m entails satisfaction (or priority 
reduction) of G 7 . This possibility allows the priority of goals 
to change as goals are met. For example, in the battlefield 50 
situation, the priority of hitting particular targets may change 
as the battle unfolds; if a bridge connecting the enemy 
supply depot to their front is destroyed, it may be unneces- 
sary to target the supply depot, and the weapons may be 
better used on other enemy assets. 55 

The objective function in this case takes the form 

si S \ ( N . 

F(5)=.XGr i- n i — cLji I l- n A 

i-i j = i ^ y v=i 

under the constraints: 

5 

z S V ; = 1, v= 1, . . . , N, Sv,- e {1, 0}, 

7=1 

0 — ( G vj = 1 T^j) = 1, i, j = 1, 
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-continued 

0 ^ (otji = 1 - Pji) S 1, G,- § 0, V = 1, N, cijj = 1. 

This problem is solved in a similar fashion, although 
employing a different form of allocation matrix. The com- 
putational complexity of its solution is proportional to N 3 , 
entailing still greater reduction of problem complexity due 
to packet implosion, in comparison with the previous case of 
non-interacting goals. 

Regardless of the problem details and efficiency of the 
resource allocation algorithms, formation of packets fol- 
lowed by packet implosion according to the invention guar- 
antees savings in the amount of computation with the 
accumulation of allocation experience. 

Standard algorithms of path algebra are applied to deter- 
mine reliable paths in the deconstructed or “imploded” 
network. Link reliability is equated to the relative frequency 
of exercising that link in the previous allocations. Corre- 
spondingly, a reliable path to the goal G, presents allocation 
of resources to G, most consistent with the previous alloca- 
tion decisions. Resource allocation to any current goal set 
Gj, G 2 , . . . G w , is obtained by finding sufficiently reliable 
paths to the set members, with the reliability of the path 
computed as the product of constituent link reliabilities. 

The role of the SIMM 40 in the example given of the 
invention is to provide performance feedback to the LTM, to 
query the user as to the allocation requirements of the 
particular problem, and to control system functions based on 
those requirements. The principal SIMM functions are to 
obtain from the user the current goals and priorities and 
performance feedback information, that is, the degree of 
satisfaction responsive to the previous cycle of resource 
allocations, and the overall estimate of allocation success. 
Where performance is satisfactory, the strength of all the 
participating links is incremented. Otherwise, those packets 
with the least reliable (i.e., the least-used) connections to the 
satisfied goals are identified, and re-allocated to the unsat- 
isfied goals. Connection strengths are then adjusted based on 
the re-allocations. 

As discussed above, the invention can be implemented in 
a number of different ways. For example, a large-scale 
system may comprise a number of individual processors, 
each making up one of the nodes of a network implementing 
the functions described above; that is, each processor would 
be programmed to receive resource allocation information 
from neighboring nodes via links, to carry out the individual 
gain calculations corresponding to the resource represented 
by that node of the network, and to communicate that 
information to the surrounding nodes by way of the con- 
necting links. Such a multi-processor computer could be 
configured conveniently according to the invention to carry 
out solutions of differing classes of problems of resource 
allocation; that is, the same machine could carry out differ- 
ent kinds of resource allocation problems according to the 
invention. In each case, the network would be provided with 
its memory, the network thus being “decomposed”, upon 
being loaded with the stored information regarding success- 
fully solved prior problems of the same class. Different 
groups of nodes would become supemodes depending on the 
class of problem to be solved at a particular time. Similarly, 
as also discussed above, the invention could be configured 
entirely in software, and run on a conventional computer; in 
this case, the nodes would be memory locations having the 
available resources stored therein. This information would 
be brought into a central processor for calculation of the 
individual gain functions and summation thereof with the 
gain functions calculated with respect to surrounding nodes 
in the network, corresponding to communication of the 
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result over the links. Hybridized versions of the system, e.g., 
using a known vector processor to cany out repetitive 
calculations under control of a conventional computer, are 
also within the scope of the invention. 

It should also be appreciated that replacement of com- 5 
monly-used nodes by supemodes can be made by comparing 
the solutions reached in successive solutions of problems of 
a similar class of problems to one another, or by determining 
which nodes are commonly employed in alternative solu- 
tions to the same problem. Accordingly, the claims which ^ 
follow should be read to include both alternatives, as a step 
in identifying the nodes to be replaced with a less-compli- 
cated group of supemodes. 

It will further be appreciated that while a number of 
examples of use of the invention have been given, and while 15 
specific implementations of the inventions have also been 
described herein, the invention is not to be limited thereby, 
but only by the following claims. 

What is claimed is: 

1. A self-adaptive system for providing progressively 2 o 
improved solutions to successive examples of a class of 
generally similar problems of resource allocation, compris- 
ing: 

a supervisory and interaction management module 
(SIMM) for receiving input data describing the goals to 25 
be met in solution of, and the resources available to 
solve, a particular problem; 

a short-term memory (STM) for receiving said input data 
from said SIMM, for receiving a list of candidate 
resources from long-term memory, and for comparing 30 
the input data to the candidate resources to determine a 
near-optimal resource allocation; 

a long-term memory (LTM) maintaining a list of candi- 
date resources and associated probabilities of goal 
satisfaction, said LTM being effectively implemented 35 
as a reconfigurable network of nodes connected to 
neighboring nodes by links, each node representing a 
step in a pathway connecting one or more resources to 
one or more goals, 

& 40 

means for computing alternate pathways between the 

nodes of the network in order to allocate resources to 
goals in deriving candidate solutions of each particular 
problem of said class of problems, and for evaluating 
the relative efficiency of each of the alternate pathways 45 
thus computed in order to determine an optimum 
solution for that particular problem with respect to the 
present configuration of the network; 

means for identifying common groups of nodes connected 
by links employed in the optimum solutions of plural 50 
examples of problems from a given class of problems; 
and 

means for effectively decomposing said network by 
replacing said identified common groups of nodes 
connected by links with fewer nodes connected by 55 
fewer links to one another, or to the nodes previously 
connected to the identified common group of nodes, for 
subsequent solution of further problems from said 
given class of problems. 

2. The system of claim 1, wherein said means for iden- 60 
tifying common groups of nodes connected by links 
employed in the optimum solutions of plural examples of 
problems from a given class of problems comprises means 
for maintaining a record of the frequency of use of each of 
the links connecting nodes in the network in the optimum 65 
solutions of successive examples of problems from a given 
class of problems. 
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3. The system of claim 2, wherein said means for iden- 
tifying common groups of nodes connected by links 
employed in the optimum solutions of plural examples of 
problems from a given class of problems identifies said 
common groups by successively assigning groups of nodes 
to packets, comparing the frequency of use of the links 
internal to each of the packets to those connecting the nodes 
of each packet to nodes outside each packet, and treating the 
nodes of the packet as an identified common group of nodes 
when the frequency of use of the links internal to the packet 
exceeds the frequency of use of the links connecting the 
nodes internal to the packet to nodes outside the packet. 

4. The system of claim 1, further comprising means for 
returning the network to its original configuration prior to 
carrying out resource allocation according to the optimum 
solution thus derived. 

5. The system of claim 1, wherein said fewer nodes 
connected by fewer links to the nodes previously connected 
to the identified common group of nodes employed to 
replace each identified common group of nodes comprises a 
single node connected by links with all nodes to which the 
identified common group of nodes was connected. 

6. The system of claim 1, further comprising means for 
storing the network configuration after identification of a 
group of common nodes in solution of a particular problem, 
and means for subsequent decomposition of the network to 
implement the stored configuration responsive to indication 
that a problem from the same class of problems is to be 
solved. 

7. A method for increasingly efficient solution of a series 
of problems from a class of problems requiring allocation of 
resources to a plurality of goals, comprising the steps of: 

defining a reconfigurable network of nodes connected by 
links, each node effectively representing a step in 
allocating given resources to given goals; 
carrying out the following steps in solution of a par- 
ticular problem: 

computing alternate pathways between the nodes of the 
network in order to allocate resources to goals in 
solution of each particular problem of said class of 
problems; and 

evaluating the relative efficiency of each of the alter- 
nate pathways thus computed, in order to determine 
an optimum solution for that particular problem with 
respect to the present configuration of the network; 
and 

carrying out the following steps after reaching an opti- 
mum solution for a particular problem with respect to 
the present configuration of the network: 
comparing the sets of nodes employed by the optimum 
solution to similar sets of nodes employed in the 
optimum solutions of other problems of the same 
class of problems; 

determining whether common groups of nodes are 
employed substantially similarly in the optimum 
solutions of plural problems from a given class of 
problems; and 

if such common groups of nodes are identified, recon- 
figuring the network for increased efficiency in sub- 
sequent solution of problems from the same class of 
problems, by replacing said identified common 
groups of nodes with fewer nodes connected to one 
another, or to the nodes connected to the replaced 
common groups of nodes. 

8. The method of claim 7, wherein said identified common 
groups of nodes are replaced by single nodes connected to 
the nodes connected to the replaced common group of 
nodes. 
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9. The method of claim 7 , wherein said step of determin- 
ing whether common groups of nodes are employed sub- 
stantially similarly in the optimum solutions of plural prob- 
lems from a given class of problems is performed by 
maintaining a record of the frequency of use of each of the 5 
links connecting nodes in the network in the optimum 
solutions of successive examples of problems from a given 
class of problems. 

10. The method of claim 7, wherein said step of deter- 

mining whether common groups of nodes are employed to 
substantially similarly in the optimum solutions of plural 
problems from a given class of problems is performed by 
successively assigning groups of nodes to packets, compar- 
ing the frequency of use of the links internal to each of the 
packets to those connecting the nodes of each packet to 15 
nodes outside each packet, and treating the nodes of the 
packet as an identified common group of nodes when the 
frequency of use of the links internal to the packet exceeds 
the frequency of use of the links connecting the nodes 
internal to the packet to nodes outside the packet. 20 

11. The method of claim 7, comprising the further steps of 
storing the network configuration responsive to identifica- 
tion of a group of common nodes in solution of a particular 
problem, and decomposing the network responsive to the 
stored configuration responsive to indication that a problem 25 
from the same class of problems is subsequently to be 
solved. 

12. The method of claim 7, comprising the further steps 
of calculating a gain component with respect to each node 
assigned to an alternate pathway connecting one or more 30 
resources to goals, and evaluating the relative efficiency of 
each pathway as a sum of said gain components of all nodes 
employed in said pathway. 

13. The method of claim 12, wherein said step of calcu- 
lating the gain component with respect to each node is 35 
performed responsive to a transaction cost assigned thereto. 

14. A method of reconfiguring an adaptive user interface 
responsive to patterns of use, said interface comprising user 
information display means and a plurality of user input 
means, said user input means permitting the user to select 40 
from among control options provided as linked sequences of 
control options and displayed for user selection on display 
means, comprising the steps of: 

modeling the linked sequences of control options as a 
network of nodes connected by links, wherein the 45 
nodes are control options and the links are associations 
between respective control options, said associations 
including both user-selected sequences of control 
options and predetermined linked sequences of control 
options, wherein linked sequences of control options 50 
are represented as packets of highly-connected nodes; 

displaying said linked sequences of control options cor- 
responding to said packets of highly-connected nodes 
as menus of control options; ^ 

monitoring user patterns of selection of control options, in 
order to identify commonly-selected control options; 
and 

adding said commonly-selected control options to said 
displayed linked sequences of control options corre- 60 
sponding to said packets of highly-connected nodes; 

thereby reconfiguring the display of menus of control 
options responsive to the sequence of selection of 
specific control options by the user as said interface is 
used. 65 

15. The method of claim 14, wherein said steps of 
displaying said linked sequences of control options corre- 


sponding to said packets of highly-connected nodes as 
menus of control options; 

monitoring user patterns of selection of control options, in 
order to identify commonly-selected control options; 

adding said commonly-selected control options to said 
displayed linked sequences of control options corre- 
sponding to said packets of highly-connected nodes; 
and 

thereby reconfiguring the display of menus of control 
options responsive to their selection by the user com- 
prise the steps of: 

providing a nominal tree structure of menus of said 
control options, said menus of said tree being linked 
such that selection of a control option from a given 
menu accesses a further menu; 

displaying a menu of available control options on said 
display means at all times when user input is possible; 

prompting the user to select control options from the 
menu displayed, while permitting the selection of other 
control options; 

accepting user input indicating selection of a particular 
control option from a particular menu displayed, and 
providing an appropriate linked menu in response 
thereto; 

accepting user input indicating selection of a particular 
control option other than from the particular menu 
displayed, and further recording the control option 
selected by the user with respect to the particular menu; 
and 

adding each control option selected by the user to the 
menu displayed at its time of selection if not already 
included therein. 

16. A self-adaptive system for providing progressively 
improved solutions to successive examples of a class of 
generally similar problems of resource allocation, compris- 
ing: 

means for maintaining a complete list of candidate 
resources and associated probabilities of goal satisfac- 
tion, said means for maintaining being effectively 
implemented as a reconfigurable network of nodes 
connected to neighboring nodes by links, each node 
representing a step in a pathway connecting one or 
more resources to one or more goals; 

means for accepting input data describing the goals to be 
met in solution of, and the resources available to solve, 
a particular problem, and for supplying said input data 
to said means for maintaining; 

means for computing alternate pathways between the 
nodes of the network in order to allocate resources to 
goals in solution of each particular problem of said 
class of problems, and for evaluating the relative effi- 
ciency of each of the alternate pathways thus computed 
in order to determine an optimum solution for that 
particular problem with respect to the present configu- 
ration of the network; 

means for identifying common groups of nodes connected 
by links employed in the optimum solutions of plural 
examples of problems from a given class of problems; 
and 

means for effectively reconfiguring said network by 
replacing said identified common groups of nodes 
connected by links with fewer nodes connected by 
fewer links to one another, or to the nodes previously 
connected to the identified common group of nodes, for 
subsequent solution of further problems from said 
given class of problems. 
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17. The system of claim 16, wherein said means for 
accepting input data comprises means for receiving a list of 
candidate resources from said means for maintaining, and 
for comparing the input data to a limited set of the candidate 
resources to determine a near-optimal resource allocation, 5 
supplied to said means for computing alternate pathways 
between the nodes of the network as an initial solution. 

18. The system of claim 16, wherein each of said nodes 
comprises means for evaluating the probability of success of 
satisfying a particular goal by allocation of resources 10 
thereto, such that said network of nodes comprises an 
element of said means for computing alternate pathways. 

19. A method for modularizing and reducing the size of a 
network of computational nodes connected by links, said 
network being employed in solution of successive similar is 
problems, comprising the steps of: 

storing information describing the connection of nodes by 
links in solution of successive problems; 

assigning groups of nodes and connecting links to can- 
didate packets; 
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evaluating the relative frequency of use of the links of 
particular packets in solution of successive problems 
with respect to the frequency of use of the links 
connecting the packets to one another, and to the 
remainder of the network; and 

replacing commonly-used packets with nodes connected 
by links to the nodes connected to the packets thus 
replaced. 

20. The method of claim 19, wherein the average fre- 
quency of use of the links of the candidate packets is 
compared to the average frequency of use of links outside 
said candidate packets in said evaluating step. 

21. The method of claim 19, wherein the total frequency 
of use of the links of the candidate packets is compared to 
the total frequency of use of links outside said candidate 
packets in said evaluating step. 

***** 



